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Random walks colliding before getting trapped 


Louigi Addario-Berry* Roberto I. Oliveira^ Yuval Peres^ 
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Abstract 

Let P be the transition matrix of a finite, irreducible and reversible Markov chain. We say 
the continuous time Markov chain X has transition matrix P and speed A if it jumps at rate A 
according to the matrix P. Fix Xx,Xy,^z > 0, then let X,Y and Z be independent Markov 
chains with transition matrix P and speeds Ajx, Ay and A z respectively, all started from the 
stationary distribution. What is the chance that X and Y meet before either of them collides 
with Z? For each choice of Ax, Ay and Xz with max(Ax, Ay) > 0, we prove a lower bound for 
this probability which is uniform over all transitive, irreducible and reversible chains. In the 
case that Ax = Ay = 1 and A^ = 0 we prove a strengthening of our main theorem using a 
martingale argument. We provide an example showing the transitivity assumption cannot be 
removed for general Ax, Ay and Xz- 
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1 Introduction 

Consider three independent random walks X, Y, Z over the same finite connected graph. What is 
the probability that A, Y meet at the same vertex before either of them meets Z1 If the initial 
distributions of the three walkers are the same, this probability is at least 1/3 by symmetry, at 
least if we assume that ties (i.e. triple meetings) are broken symmetrically. 

Now consider a similar problem where the initial states Xq,Yq,Zq are all sampled independently 
from the same distribution, but Z stays put while X and Y move. What is the probability that X 
and Y meet before hitting Z? 

There are several examples of bounds PSIE] relating the meeting time of two random walks to the 
hitting time of a fixed vertex by a single random walk. These typically provide upper bounds for 
meeting times in terms of worst-case or average hitting times, sometimes up to constant factors. In 
light of this, it seems natural to conjecture that the probability in question is at least 1/3. However, 
the previous argument by symmetry fails. In fact, to the best of our knowledge, no known universal 
lower bound for this probability is known. 

It will be convenient to consider the problem in continuous time. For the remainder of the paper 
let P be the transition matrix of an irreducible and reversible Markov chain on a finite state space 
with stationary distribution tt. Let X and Y be two independent continuous time Markov chains 
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that jump at rate 1 according to the transition matrix P and let Z ~ tt be independent of X and 

y. 

We define to be the first time X and Y meet, i.e. 

M^-'^ = inf{t > 0 ; Xt = Yt}. 

We also dehne; 

= inf{t >0: Xt = Z} {W e 
We write and A M^’^. 

1.1 Main results 

Our first result proves a universal lower bound on the probability for the class 

of transitive chains. First we recall the definition. 

Definition 1.1. Fix a chain with transition matrix P and state space E. An automorphism of P 
is a bijection ip : E ^ E such that P{z,w) = P{ip{z),(p{w)) for all z,w. The chain P is transitive 
if for all x,y £ E there exists an automorphism p of P with p{x) = y. 

Theorem 1.2. Let P be the transition matrix of a finite irreducible and reversible chain with two 
or more states. Assume Xq and Yq are independent with law tt. If P is transitive, then 



Next we consider a more general setup. We say that a random walk W has speed Xw and transition 
matrix P, if it jumps at rate Xw according to the matrix P. 

Suppose again that P is the transition matrix of an irreducible and reversible Markov chain on 
a finite state space with stationary distribution vr. Let Ax = 1,0 < Ay < 1 and 0 < A^ < oo. 
Let X, Y and Z be three independent continuous time Markov chains with speeds Ax, Ay and Xz 
respectively and transition matrix P. 

For the remainder of the paper, we write P for the probability measure under which Xq, Yq and Zq 
are independent with law tt. We also write Pa,fe,c in the case when (Xo,lo,-^o) = {a,b,c). For 
computations that only involve two chains we drop one index writing only Pa,;,; which two chains 
are involved will always be clear from context. Likewise, we write Pa when only one chain is 
involved. We define as above and redehne: 

= mf{t >0:Xt = Zt}{W£ {X, T}). 

M®°°d = and A are defined as before. Again we are interested in uniform 

lower bounds on the probability of the event {M§°°d < that have good dependence on the 

three speeds. 

Theorem 1.3. There exists c > 0 such that the following holds. Let P be the transition matrix 
of a transitive and reversible ehain with stationary distribution vr and at least two states. Suppose 
that X, Y and Z are three independent continuous time Markov ehains with speeds Ax = 1, Ay < 1 
and Q < Xz < oo and transition matrix P started from vr. Then 

Pf Mg°°d < Md®d) > ^ , . 

V / (\/l + Xz + \/Ay + Xz)^ 
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The proof shows that we may take c = 1/4752, which implies a version of Theorem 1.2 with 1/4 


replaced by l/((\/2 + 1)^ • 4752). The constant c most likely can be improved, but the dependence 
of the lower bound on Xz is sharp when Xz +oo. Indeed, if P is simple random walk over a 
large complete graph with n vertices, then 


< M 


bad 


—- o(- 

2(1 + Xy + Xz) \n 


where the term 0(l/n) corresponds to the possibility of meetings at time 0. 

It is natural to ask if our theorems can be extended to all transitive chains. The next theorem 


shows that the answer is no for the more general Theorem 1.3 The theorem essentially asserts that 
there are graphs where typical meeting times are much smaller than typical hitting times. 

Theorem 1.4. For all e > 0 there exists a finite connected graph G such that if P corresponds to 
simple random walk on G and Xx = 1, Ay = 0 and = 1, then < M^^^) < e. 


On the other hand, we believe that for certain values of Ax, Ay and Xz, universal lower bounds 
are possible without transitivity. Here is a concrete conjecture, which relates to the setting of 
Theorem 11.21 

Conjecture 1.5. If Ay = Ax = 1 and Xz = 0, the inequality 

]p(^M^ood < ^bad^ > 

holds for all finite irreducible and reversible chains P. 


Alexander Holroyd (personal communication) pointed out an example showing that for any d > 0 
there exist transitive chains for which P(M®°°^ < < 1/3 + <5. We describe this example 

in Section This means that, if true. Conjecture |1.5| is best possible even for transitive chains. 
However, we note that any uniform lower bound 


P 



< M 



> c > 0 


for all P, and for Ax, Ay and Xz as in Conjecture 1.5 


would be a new result. 


Remark 1.6. Without reversibility, the conjecture fails badly. Consider a clockwise continuous 
time random walk on a cycle of length 2n. More precisely, with P = {pij)i<ij<n we have pij = 1 
if j = {i + 1) mod n and pij = 0 otherwise. The distance between independent random walkers 
behaves as continuous time simple symmetric random walk reflected at 0 and n. So started from 
stationarity, it typically takes such walkers time of order to meet. On the other hand, the hitting 
time of any point is at most of order n. 


Before we continue, we say a few words about the main proof ideas. The unifying theme of the 


proofs of Theorems 1.2 and 1.3 is the relationship between meeting times and hitting times of single 
vertices when P is transitive. Aldous and Fill [U Chapter 14/Proposition 5 and Chapter 3] have 
related the expected values of these random variables via martingales, and we use similar ideas to 
prove Theorem |1.2[ 


For the proof of Theorem 1.3, we need a stronger result establishing identities in distribution of 


meeting and hitting times, which (somewhat surprisingly) seems to be new: see Lemma 3.5 below. 


The proof of Theorem 1.3 requires several other tools, including small time estimates for hitting 


times (Lemma 3.4) and an occupation time formula for product chains (Lemma 4.2). 


3 













The proof of Theorem 1.4 builds a graph with two parts: the “Up” part concentrates the bulk of 
the stationary measure, but the “Down” part is where meetings tend to happen, and they happen 
fast. As a result, only a negligible fraction of the “Up” part is explored before X and Z meet, and 
the upshot is that with high probability. 


2 The 1/4 lower bound 


In this section we prove Theorem 1.2 The argument is fairly short, and much simpler than the 


one for the more general Theorem 1.3 Before presenting the proof, we recall some standard facts 
about hitting times which are also used later on. 


The hitting time of a state z G D by A is the first time t at which Xt = z, i.e. 

rf := inf{t > 0 : Xt = z}. 

We define r/ similarly and we also let 


( 2 . 1 ) 


:= max Tr/l and fhit := Ea,rr/‘l. 

xen {x,z)&n 


( 2 . 2 ) 


Whenever there is no confusion, i.e. if there is a single chain in question, we will drop the dependence 
on A or y from the notation of the hitting times. 

Lemma 2.1. For any reversible chain with two or more states we have 

0 < fhit < Kit- 

Moreover, if X is a reversible and transitive chain, then for all x,z £ Q and all t >0 we have 

^x{Tz <t) = f’z{Tx < t) . 

Proof. For a proof of the first assertion in discrete time we refer the reader to [3l Lemma 10.2]. 
A proof of the symmetry property specific to transitive chains can be found in [H Lemma 1, 
Chapter 7]. □ 

Lemma 2.2 (Aldous). Let P be an irreducible and reversible transition matrix. Suppose that X 
andY are independent continuous time Markov chains that jump at rate 1 according to the transition 
matrix P. For all x,z G Ll define f{x, z) := E^, [r/-]. Then f{Xt, z)+t, f(Yt, z)+t and f{Xt, Yt)+2t 
are martingales up to time 

S := A A rf A r/, 

for any initial states {x,y) G and any z £ fi. 


For a proof of the lemma above we refer the reader to [H Chapter 14/Proposition 5 and Chapter 3]. 


Proof of Theorem 11.21 Since A and Y are two independent copies of the same chain, we have 
Ea [r/-] = Eq [r/] for all o, b. By Lemma 2.2 we now get that {Gt)t>o is a martingale up to time S, 
where 

Gt := Ext [rf ] + Ey, [r^] - Ex, [r^] {t > 0). 
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This martingale is bounded (because the state space is finite). The fact that the chain is finite and 
irreducible implies S < oo almost surely for all initial states. We deduce from optional stopping 
that 


E[Go] = E[Gs]. 


The left hand side above is given by the quantity 


defined in (2.2). This is because 


E[Go] = E, [ri^] + E, [rf ] - 7r(y)E, [r^] = E, [rf ] , (2.3) 

y&fl 


where the second equality follows from the fact that for a transitive chain, Et^ [t^] is independent 
of y. Using this a second time yields 

= E[G5] . (2.4) 

On the other hand, at time S we have two alternatives. 


• If A either Xs = z, and then Gs = Eyg [r^] — E^ [r^], or = z, in which 

case Gs = Ex^ [t^] — Exg [t^] . In both cases Gs = 0: this is obviously true in the second 

case, and follows from Lemma 2.1 in the first case. 

• On the other hand, if < rf A rj, then Gs = 2Exs [t^] < 2thit- 

We deduce that 

G5<2thitl(Mg°°'i<rf Arf). 


Plugging this into (2.4) gives 


<2 4itl 


< M 


bad 


Using that thit < from Lemma 2.1 finishes the proof. 


□ 


3 Towards the general lower bound 


In this section we collect the tools that we will use in the proof of Theorem 1.3 We first argue that 


the obvious “fix” to the proof of Theorem 1.2 does not work in all cases. Indeed, a straightforward 
extension of Lemma 12.21 establishes that 

Gt := /(W, Zt) + fiYt, Zt) - ^ + fiXt, Yt) 

i + Ay 

is a martingale up to time S. One can see that in this case 


= (' - I^) 


which easily yields 


< M 


bad 


1 

> - 
- 4 


1 - 


2Xz 


1 + Ay 

In particular, we obtain the same bound as in Theorem |1.2| provided that = 0 and Ax / 0. 
However, this bound becomes useless when Xz > (l+Ay)/2. Other linear combinations of f{Xt, Zt), 
f{Yt,Zt) and f{Xt,Yt) also fail to achieve our goal when Az is large. So, in general a different 
strategy is needed. 
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3.1 Hitting times for states and trajectories 


In this section we collect some results on hitting times for a single Markov chain. 


Recall the quantity defined in (2.2). The next lemma shows that, up to a constant factor, 
also bounds expected hitting times of moving targets, from arbitrary initial states. This lemma is 
essentially due to Oliveira [H Lemma 1.1], but in this particular form it appeared in [5]. 


Lemma 3.1. Let X be a reversible Markov chain taking values in 12 and h = {ht)t>o ® determin¬ 
istic, cddldg, Ll-valued trajectory. If 


Th := inf{t >0:Xt = h}, 


then for any x € Ll, 


lEa; [Th] <11 thit • 


Proof. In using [H Lemma 1.1] it is proved that 


[tu] < Cthit- 


for a universal constant c > 0, where thit is as in (2.2). Inspection of the proof [5] shows that 
c < 4 + 5/4, therefore 2c < 11. Lemma 2.1 finishes the proof. □ 


For a reversible transition matrix P we let A* = maxj >2 |Aj|, where 1 = Ai > A 2 > A 3 ,... are its 
eigenvalues in decreasing order. We define the relaxation time via trei = (1 — A*)“^. 

The next lemma bounds the probability that Tz is small for reversible chains. Clearly, if no as¬ 
sumption is made on z and on the starting state x, such an estimate cannot be very good (think 
of two adjacent points on a path). The next lemma shows that if we choose the “right” starting 
state, and only consider the majority of possible target states, we can show that Tz dominates an 
exponential random variable with mean pei. This will be used later to upper bound the probability 
that Tz/thit is very small. 

Lemma 3.2. Let X be a reversible chain. There exist x € H and a subset A C 12 with stationary 
measure '7r{A) > 1/2 such that, if ta ■= Ta.m.z^ATz, then for any t > 0, 

Px (ta > t) >e ‘rel . 


Proof. We use the spectral theory of reversible chains [H Section 3.4]. The first step is to note 
that P has a non-zero eigenfunction : 12 —)• M such that 

This eigenfunction is orthogonal to the constant eigenfunction in the inner product induced by vr, 
so it must take both positive and negative values. We may assume without loss of generality that 
the set 

A -.= {z : ^p{z) < 0} 

has measure 'k{A) > 1/2 (if that is not the case, replace (/? with —+). Choose x £ LI with (p(x) > 0 
as large as possible. On one hand 

Vt > 0, n G 12 : E„ [(^{Xt)] = ^ (3-1) 
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In particular, for all u G ^ we have Eu[(^(Xi)] < 0. Since G A, the strong Markov property 
then gives 


Ea; [ip{Xt) l(Tyl < t)] = Exr^ [(p{Xt-rA)] 1 {ta < t) 

< E^ [0 • l(r^ < t)] = 0. 


Plugging this into (3.1) with the choice u = x, and recalling (p{Xt) < (p{x) always, we obtain 

e Gel ip{x) = Ej, [ip{Xt)] < Ea, [if{Xt) 1 {ta > t)] < ip{x) Fa, {ta > t). 

Dividing both sides by (p{x) (which is > 0) finishes the proof. 


□ 


3.2 Results for transitive chains 

In this section we prove results on hitting times under the assumption that P is transitive and 
reversible. 


3.2.1 A small-time estimate for hitting times 


We start by recalling a result which follows from the complete positivity of the law of when 
starting from tt together with bounds from Aldous and Brown [2]. 

Lemma 3.3 (Aldous-Brown). Let P be an irreducible and reversible chain. Define f(s) = Et^[tz — s \ Tz > s] 
for all s > 0. Then f is an increasing funetion and 

sup/(s) < Et,[Tz\ +trel- 


Proof. Let Q = I — P and Qz be the restriction of Q to D \ { 2 ;}. We recall the complete positivity 
of the law of Tz starting from vr (see for instance [21 eqn. (18)]): there exist non-negative constants 
(Pi, 1 < * < f^) such that for all t 

m 

Et,{Tz >t) = 

i=l 


where 0 < 71 < ... < 7 ^ are the distinct eigenvalues of —Qz- Note that 7 i ^ = Ea[T 2 ], where a is 
any quasistationary distribution on D \ {z} corresponding to the eigenvalue 71 . 

Using the above representation we can rewrite / as follows 


fis) 


e^{tz > t) ^ YT=iPi^ 

A E.(r, >s) ET=lP^e-^^^ 


A straightforward differentiation now gives that / is increasing. From the above expression we also 
deduce 


lim f{s) = — = Ea[Tz] . 

s^oo 

From [21 Corollary 4] we have 

Ea[Tz] < Et,[Tz] +trel- 

we conclude that for all s 

f{s) < Ea[Tz\ < Et,[Tz\ + trel 


Therefore, using this and the fact that / is increasing and (3.2 


(3.2) 


which completes the proof. 


□ 
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The next lemma essentially improves upon Lemma 3.2 from Section 3.1 


Lemma 3.4. Suppose that P is reversible and transitive. Then for any x € it, there exists a 
subset Ax C n with 'n{Ax) >1/2 such that, for any 0 > 0, 

~TT~\ X] < 6\/0 


Proof. By Lemma 3.2 there exists x £ Tt and a set A = Ax with Tt{Ax) >1/2 such that 

IPx (tA > t) >e ‘rel . 

Since the chain is transitive, this in fact holds for all x. We now fix x G fl and 9 > 0. 

We will consider two cases separately: trei < VOthit and trei > VOthit- 

Suppose first that pei > V^thit- Since ¥x {tz > t) >¥x {ta > t) for all z ^ A, we obtain 


1 -Llhit 0tw 

vr(z) Px {tz > 9 thit) > e Gei > 1 - 


Tr{A) 


zGA 


^rel 


^ >1-V9 


which concludes the proof in this case. 

Suppose next that trei < V^^hit- la this case it suffices to prove 

Vz G n : {tz > 9 tut) > 1 — sVd. 


(3.3) 


To see that this suffices, we use the fact that P is transitive and apply Lemma 2.1 to obtain that 
Px (tz > t) is symmetric in x and z. As a result, (3.3) implies 

1 - sVe < P^ {tx > 9 thit) = 7r(z)P2 (tx > 9 thit) = T^{z)'¥x [tz > 9 thit) • 


zeo. 


zefi 


Therefore we obtain 


Since vr(A) > 1 / 2 , we conclude 


yy 7 r(z)Pa, {tz < 9 tut) < 3 V 0 . 


WLn y] {tz < 9 thit) < 6V^. 


It remains to prove (3.3). Since P is transitive, Ett \tz \ = t ^^., is independent of z. Moreover, we are 
assuming that tj-ei < v^thit, and hence using Lemma |2.l| we get that tj-ei < 2\/0tJ(j^. so 

Ett [Tz\ + tre\ < (1 + 2\/0) thif (3-4) 

We now obtain for all s > 0 and for all z G 

thit = IEtt [Tz] < S + E^ [r^ - S I Tz > s] P^ (Tz > s) < S + (E^fr^] + tre\)lPn{Tz > s) 

< S + (1 + 2 V 9 ) thit (A: > s) , 

where the second inequality follows from Lemma 3.3 and the final one from ( |3.4[ ). Taking s = ^4t 
gives 


(p > 9tl^^) > 


1 - 


I + 2V9 


> 1 - 2 V 9 . 


This now finishes the proof of (3.3), since for all z G fl we have 

P^(r^ > 9tut) > > 204t) > 1 - 2V2y/9 > 1 - 3\/0, 

where for the hrst inequality we used again Lemma |2.1[ 


□ 















3.2.2 Distributional identities for meeting and hitting times 


Our next result shows that the distributions of hitting and meeting times are intimately related for 
transitive and reversible P. 

Lemma 3.5. Let P be a reversible and transitive transition matrix. Let X,Y and Z be three 
independent continuous time Markov chains with speeds Xx = l,Ay > 0 and > 0 and transi- 

9 

tion matrix P. Then for all (x,z) G , the distribution of x^+Xz same as the 

distribution of under ■ 


A special case of this lemma is when Ax = A^ = 1, m which case we obtain the following corollary 
of Lemma 13.51 




1 


= [rf]. 


-(x,z) L-- J 2 

This equality is well known and is usually proven by martingale methods such as the ones used in 
the proof of Theorem 1.2 Somewhat oddly, it seems that Lemma 3.5 is new, or at least was not 


widely known before. We also note the following corollary of Lemma 3.4 and Lemma 3.5 


Corollary 3.6. Let P be a transitive and reversible transition matrix and let X, Y and Z be three 
independent continuous time Markov chains with speeds Xx = 1 and Xy,Xz > 0 respectively and 
transition matrix P. Then for all x gLI there exists a subset Ax C Ll with tt{Ax) >1/2 such that: 

-7^ {M^’^ < 6»4it) < Qy/{l + Xz)e 

zeA 


and 


-7^ Y (M^’^ < 6»thit) < Gy/iXy + Xz)0. 

zeA 


Proof of Lemma 13.51 Define the functions 

9(x,z){t) ■= Ex {tz < (Ay + Xz) t) and fx,z{t) := ^(x,z) (M^’^ < f) {{x, z) G t > 0). 

We will be done once we show that gx,z{t) = f{x,z){t) for all (x, z) G and t > 0. These equalities 
are true (by inspection) when t = 0. We are going to show that the functions {f{x,z)i')){x,z)&n'^ 
( 5 x,z(‘))(x,z)er 22 satisfy the same linear system of ordinary differential equations (with the derivatives 
at t = 0 interpreted as right derivatives). Then the equality for all t > 0 will follow from the general 
uniqueness theory of linear ODE’s. 


To prove that / and g satisfy the same system of ODE’s, we will use a standard formula for the 
cumulative distribution function of a hitting time. If (V))t>o is an irreducible continuous time 
Markov chain over a set Lly with transition rates q{v, w), and A C Dy is a nonempty subset of the 
state space, the hitting time of A by E satisfies 


(3.5) 


(r^ <c A = i ^ ^ 

dt ” ' ^ i \ g(u,u;) (P^ (rX < t)-E,; (rX < t)), u G Dy\A. 

The derivative is understood as a right derivative at time t = 0. 

Let A = {(x,x) : x G 0} C be the diagonal set. We first apply (3.5) to the product chain 
(Ei)t>o = {Xt, Zt)t>o, with Lly = and A = A. In this case ^ a,nd a straightforward 

computation with the transition rates gives: 


, [ 0, x = z 

-jifx,zit) = { -^>Ex'en-E(a’,a:') (/(x',z)(i) -/(x,z)(i)) (3.6) 

( +^zJ2y(znP{z,z'){f^x,z’){t) - f(x,z)(^)), x^z. 
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We now apply the same formula (3.5) with {Vt)t>o = {Xt)t>o- Note that g(x,z){t) ■= {'’'z < s{t)) 

where s{t) = (Ay + Xz)t, so the chain rule implies 


* *(“’•')**' ^ 1 (V +Az) 


X = z 

-9{x,z)it)), x^z. 


(3.7) 


We will now make crucial use of transitivity, which allows us to use Lemma |2.1| to deduce that 
IPx < (Ay + Xz) t) is symmetric in x and z, i.e. 

.X / , \ _ TO 


{xz < {Xy + Xz)t) =¥z{x^ <{XY + Xz)t), 


that is gx,z{-) = gz,x{-) for all x, z. This allows us to reverse the roles of x and z in (3.7) to obtain: 

(3.8) 


d 


0 


X = z 


dt \ (Ay + Xz) J2 z'&Q ^0 (.9{x,z'){t) - 9(x,z){t)), X^Z. 


We add the two formulas (3.7) and (3.8) with weights Ay/(Ay + A^) and A^/(Ay TA^) respectively. 
The upshot is: 


d 


0 , 


X = z 


,.9{x,z){t) = < >^YY)x'&nPix,x'){g(^x',z){t) - 9{x,z){t)) 

+>^zYlz'&nPi^^z')i9(x,z'){t) - 9{x,z){t)), xz/zz. 


This is precisely the system of ODEs we obtained for the /’s in (3.6) and it concludes the proof. □ 


4 The general lower bound 

In this section we prove Theorem 1.3 

Proof of Theorem II.31 We let n = |fl| denote the number of states. The transitivity assumption 
implies 7r(u) = 1/n for all v € kl. The next lemma will be used in the proof. We defer its proof 
until Section im 

Lemma 4.1. Let P he a reversible and transitive transition matrix. Let X,Y and Z be three 
independent continuous time chains with transition matrix P and speeds Xx = 1 and Xy,Xz > 0. 
Let g be the probability measure given by 

(4.1) 


Then 


g{A) := P ((Xj^good, Z^^/good) G A for A C Q x Q x Q. 


I 


(w = Yt,t< dt < 

Our proof is based on the analysis of the time that X, Y spend on the diagonal A = {(x, x) : x G 11} 
prior to time i.e. 

T:= / l{Xt = Yt)dt= / l{Xt = Yt,t<M'^^^)dt. 

Jo Jo 

Note that if and only if T > 0, so 

E[T] = E fr < m’’ 


(4.2) 
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(4.3) 


= IE„ 


Ljo 


< M 


l(Xt = Yt,t< 
f^j^good ^ ^bad^ ^ F^(^Xt = Yt,t< dt. 


Lemma [4.1| upper bounds the integral appearing above. Thus in order to obtain a lower bound for 
it suffices to lower bound 


E[T] = F(^Xt = Yt,t< dt. 

Using reversibility and the fact that vr is uniform for a transitive chain we obtain 

F(^Xt = Yt,t< =F{Xt = Yt,'^s <t,Xs^ and T, / Z,) 

= F{Xo = To, Vs <t,Xs^ Zs and T, + Z,) 

^(x,x,z) (Vs <t, Xs^ Zs and Ys / Zs) 


(4.4) 


E 
E 




\x,x,z) >t) _ I 


n'^ 


n 


^ 7r(x)7r(z)] 


{x^x^z) 


Plugging this back into (4.4) gives 




{x^x^z) 


x^z<^Q, 


> t] dt 


> t 


(4.5) 


At this point we recall that A M'^’^, therefore 

V(x, z) G L!^ ; > t) > 1 - P(.,.) (M^’^ <t)- (M^’^ < t) . 


By Corollary |3.6[ for each x G U there exists a subset Ax with '7r(Aa;) >1/2 for which we have the 
following bound for all t > 0 


1 — 6{y/l + + y/Xy + Az) J -— 

V thit 


^ 7r{z)F,^x,x,z) > t) > 7r(A^) 

ZG.-A.X 

Therefore, fixing ^ > 0 and x G fl: 

[ Y1 >t^ dt > ]- j ^ ~T^ > t) dt 

Jo Jo ,.^4 x) 


>- 


0 L 


1 — 6(-\/l + Xz + \/Ay + Xz) \ -— 

V Ihit 


dt 


We can maximize the right hand side by taking 


1 — 4 + y/Xy + Xz) \ { -— 

Ihit 


^hit 


36 {y/1 + Xz + VXy + XzY ' 
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which gives the bound 


Vx G 




{x^x^z) 


>t] dt> 


^hit 


zGU 


216 (t/ 1 + + \/Ay + Xz)"^ 


Combining this with (4.5) gives that 

E[T] > 


thit 


216 n (\/l + Xz + VAy + ^zY 


Therefore, using this together with Lemma 4.1 and (4.3) we conclude 

< ^ 


4752(\/l + Xz + \/AiALp7\^)^ 


and this finishes the proof. 


□ 


4.1 Occupation time up to a stopping time 


The goal of this section is to prove Lemma 4.1 We start with a more general setting. We give the 
proof of the lemma at the end of the section. 


It is well known that a finite irreducible chain {Vt)t>o with state space fly, started from a point x 
and stopped at a stopping time r > 0 with 14 = x, satisfies: 


Vu G fly : Ej; 



v) dt 


Trv{v)E^ [r] , 


where vry is the unique stationary measure of {Vt)t>o (some simple conditions on r are necessary 
for this). There are also extensions of this lemma to the case where Vq and 14 are not necessarily 
equal, but have the same distribution [U Proposition 2.4, Chapter 2]. The following lemma extends 
this idea even further, and shows that r may be a stopping time for a “larger” Markov chain. 


Lemma 4.2. Suppose {Ut)t>o, {Vt)t>o are independent, irreducible, continuous time Markov chains 
with finite state spaces Qu and fly respectively. Assume p. is a probability measure over x fly 
and that t is a stopping time for the process {Ut, Vt)t>o with the following properties. 


( 1 ) > 0 ) = 1 ; 

( 2 ) E^ [r] < oo. 

(3) (Fo = •) = P/. = •). 


Then for all v G fly 


E,, 


L2o 


l(Vt = v) dt 


where vry is the stationary distribution ofV. 


M ^v{v) 


Proof. In this proof we will interchange integrals, expectations and summations several times. 
Instead of justifying this at each step, we note right away that all of these interchanges are valid, 
because the integrands are non-negative. 
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Consider the row vector h with nonnegative coordinates 


h{v) := Ep 


±{Vt = v) dt 


roo 

/ = v,T > t) dt {vgQv)- 

JO 


Note that Xliiey ~ M ^ ^ because r > 0 a.s.. Letting Q be the generator of {Vt)t> 0 i 
will show below that 

hQ = 0. (4.6) 

This identity implies that h/E^ [r] is one invariant probability distribution for V. Since vry is the 
unique invariant distribution, we deduce that for all v G lly 


hjv) 




which is precisely what we need to prove. 
We will derive hQ = 0 from the limit 


Vu G riy : hQ{v) = lim 
£\0 


[he^^]{v) — h{v) 
e 


(4.7) 


In order to compute the limit we recall e^^(w,v) = = v) for all w,v ^ Qy Therefore 

roo 

[he'^^]{v)= ^ h{w)Fw(ye = v)= F^{Vt = w,T > t) F^{Ve = v) dt. 

w€.Qy w€.ftv 

Crucially, the fact that r is a stopping time for U,V implies that the event {Vt = w,t > t} is 
measurable with respect to {Ug, Vs)s<t- Using that V and U evolve independently and the Markov 
property for V implies 

Ff, {Vt = w,T > t) F^ (14 = v) = {Vt = w,T > t) Ff, {Vt+s = V \Vt = w,T > t) 

= P^ {Vt = W, Vt+s = V,T >t). 


Plugging this back in the previous display gives 

roo 

[he^^]{v) = / F^{Vt+e = v,r > t)dt 

Jo 

roo roo 

= F^ {Vt+e = v,T > t + e) dt+ / F^ {Vt+e = v,t <T <t + e) 

Jo Jo 


dt 


= : (/) + (//). 


(4.8) 


The first term is 


so 


/ oo r£ 

P^ {Vt = v,T>t) dt = h{v) - J Ffj,{Vt = V,T > t) dt, 
{!) - h{v) 


-P^ (Uo = ti,T > 0) = -P^ (Uo = v) 


(4.9) 


because r > 0 always. Regarding the second term, we have 

roo roo 

{II) = / P^(Vt = V,Vr = V,T < t < T + s) dt + / P^(Ut = V,Vr V,T <t <T + e) dt. 

Jo Jo 

(4.10) 
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For the first term on the right hand side above we obtain 


lim 
€—^0 


F^{Vt = v,Vr = v,T <t<T + e) dt 


As for the second term in the sum in (4.10) we get 

POO POO 

/ F^{Vt = v,Vr ^ V,T <t < T + e) dt = / E^[Ffj,(Vt = 

Jo Jo 

POO 

= / IE^[l(r <t <T + e)Ffj_{Vt = v,Vr \ r)] dt. 


= F^{Vr = v). (4.11) 

V,Vr ^ V,T < t < T + S \ t)] dt 


On the event {r < t < r + e} in order to have Vt = v and Vr ^ v, there must exist at least one 
jump of the Markov chain in the time interval [r, t], which on this event has length less than e. 
Therefore, we obtain that on the event {t <t < t + e} 


F^{Vt = v,Vr^v\T) = 0{e). 


Therefore we deduce 


<t <T + e)F^{Vt = v,Vr^v \ t)] dt = O(e^). 


Hence this together with (4.11) gives that 

ill) 


Combining this with (4.9) and ( |4.8[ ) gives: 

[/ie^‘ 5 ](u) — h{v) 


{Vr = v) as £ \ 0. 


F^ (Vr = v)-Ff, (Vo = v) 


Our assumption that (Vq = •) = IP/x ~ ') implies that the right hand side above is zero. 
Plugging this back into ( |4?fl ) gives hQ = 0 and finishes the proof. □ 

Proof of Lemma 14.11 We want to eventually use Lemma 4.2 to estimate the integral, which we 
can rewrite as 


(4.12) 


(Xt = Yt,t<M'°^A dt = Ve^ 


/ l{Xt = Yt = x) dt 

xeo 

Jo 


This is a sum of terms of the form demanded by Lemma 4.2 just set (Ut)t>o = {Zt)t>o and 
(Vt)t>o = (Xt,Vt)t>o- However, other conditions are needed for this lemma to apply, and one of 
them clearly fails: the distribution of (Xq,Yo) is not the same as that of (, Tj^fbad). To see 
this, simply note that whereas Xq = Yq under /r (as we will see below), typically Aj^^bad / Y^bad. 
It turns out that we can circumvent this problem by defining 


r = inf{t > : Xt = YJ. 

Note that Xt / Yt for all <t<T. Therefore 

r (Xt = Yt,t< dt = V [ l(Xt = Yt = x) dt 

^ ^ xen Ldo 


(4.13) 


(4.14) 
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Clearly r is a stopping time for {Xt, Yt, Zt)t>o- We claim that r and the initial distribution fj, satisfy 
the conditions (1) — (3) of Lemma |4.2[ 

First, IP/^(r > 0) = 1, since IP;i(Xo = Iq / Zq) = 1 and IP/i(T > > O) = 1. Hence condition (1) 

of Lemma l4.2l is satished. Next we show that 


< 22t 


* 

hit ’ 


(4.15) 


which will imply that condition (2) is also satished. Recalling that r = inf{t > : Xt 

we have 


[r] < max ) 


M 


bad 


+ max 


MSOod 


Yt], 


The hrst expectation is at most the meeting time of X and Z, which is independent of Y. Lemma 3.1 


implies that, conditionally on Z, this is at most llt^it almost surely, so Ey 2) < llt^jf Sim¬ 
ilarly, is the meeting time of X and the independent trajectory Y, and Ey/y/< 


Note now that by dehnition fj. is supported on the set {(x, x,z) : x z}. One can also check that 
is invariant under the action of any automorphism tp of P, i.e. fi{x,y,z) = fj,{ip{x),(p{y),(p{z)). 
This together with transitivity give that the marginal of y on the hrst two coordinates is uniform 
on the diagonal set A = {(x, x) G : x G fl}. 


Similarly the law of {X^, Tr) is invariant under the action of any automorphism ip. Using transitivity 
again we obtain that (At-,U-) is uniform on A. Therefore, condition (3) is also satished. 

We can now apply Lemma [4.2| to get that 

rp„ (x, = Y„t < ^ . 

x£n ^ ^ 


where the inequality follows from (4.15). This concludes the proof. 


□ 


5 Non transitive chains 

The goal of this section is to prove Theorem |1.4[ Throughout the section we hx e > 0 and 
let C = 6/e. In what follows is the complete graph on r G N \ {0} vertices. 

For n G N construct a graph Gn as follows: begin from a clique Kn+i and n disjoint copies of Kk 
with k = VCn. Fix a vertex v G Kn+i and add exactly one edge from v to each copy of K^. See 
Figure [1] for a depiction of the graph. 

Let n be the vertex set of Gn- We call Down the set of vertices belonging to Kn+i and Up = D\Down 
the rest. 

Let P be the transition matrix of a simple random walk over G and vr its stationary distribution. 
Let X, Y and Z be independent random walks starting from tt with transition matrix P and speeds 
Ax = 1) Ay = 0 and Xz = 1- 

The idea is that by choosing e sufficiently small, the stationary measure of Down becomes arbitrarily 
small. So if we start X, Y and Z according to vr, then it is very likely they will all start from different 
cliques in Up. Let T be the ^/n-th time that X visits the vertex v. We will show that as n —)• 00 
the probability that X and Z collide after time T is arbitrarily small. Moreover, we will show that 
the probability that X and Y collide before T is arbitrarily small as n —)> 00. Combining these two 
assertions will complete the proof. 
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n 



(r) 

For all r > 0 we define Ty ' to be the time of the r-th visit to v. Formally, 

= inf{t > 0 : Xt = v} 

and for i > 1 we define 

rW = inf{t > : Xt = v, Xt- / v}. 

Lemma 5.1. There exists a = a{C) > 0 independent of n such that for all x,z £ Ti and all r >1 
we have 

Proof. First note that by the strong Markov property we have for all r > 1 

supP,,> rM) < supP„,,(m^’^ > . 

Using the strong Markov property again, for r > 1 we obtain 
supP„,^(m^’^ > rW) = supP^,^(m^’^ > | 

< supP^,u,(M'^’^ > supP^,^(m^’^ > 

By induction for all r > 1 this yields 

supP „,2 < ^supP „,2 

So we complete the proof by showing that 

supP,, 2 (m^’^ >r«) < 1 -. 
for a positive constant a depending only on C. 


a 


(5.1) 
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Let T = inf{t > 0 : Zt G Down \ {i’}} and fix u; G Down \ {f}. By symmetry, for all 2; we then have 




< Tv 


( 0 ) 


mm 

a,b G Down\{i;} 


< T<»>) , 


where the factor 1/2 corresponds to the probability that the first time X jumps it goes to Down\{u}. 
If Xq = a G Down \ {u}, then , and hence if also b G Down \ {u}, then 

< rW) > A T^) = 

It remains to show that for a positive constant ci we have 

minP^^^^r < > ci > 0. (5.2) 


If 2; G Down \ {u}, then this probability is 1 and if 2: = u it is easily seen to be at least 1/4. So we 
assume that 2; G Up. Let x be the unique neighbour of v lying in the same clique as 2:. Then the 
time T can be expressed as r = + Tx^v + ^/,Down\{'u}j where the time Tr^s stands for the first 

hitting time of S starting from r. Using this, it is then not hard to see that there exists a positive 
constant c such that uniformly over all 2; G Up we have E[r] < c/c^. Moreover, if Xq G Down \ {u}, 
then is an exponential random variable with mean n. By Markov’s inequality we obtain 

< r^) > P,(r < 2E[r]) • > 2E[r]) > ^ ds = 


Note that this bound does not depend on 2;. Since k 
follows. 


y/Cn and E[r] < ck"^ the bound in (|5.2) 

□ 


Proof of Theorem 11.41 We show that for n sufficiently large, the graph G = Gn satisfies the 
claim of the theorem. 

It is not hard to verify that for n large enough, in Gn we have 

2 

7 r(Down) < —. 

L/ 

Let A be the set of pairs (x, y) such that y G Up and x is not in the same clique as y. Then 
let E = {(Xo,Tb) £ By the preceding bound P(U^) < 3/(7 = e/2 for n large enough. We then 
have 

jpj'^good < ^bad^ < < M^’^) = < M^’^,E^) 

< sup Fx,y,z{M^’^ < M^’^) + (5.3) 

x,y,z: {x,y)GA ^ 

Therefore, it suffices to upper bound the last probability appearing above. Fix any 2; G D and 
(x, y) G A. For r to be determined later we have 

< M^’^) < ¥x,y < ri")) + P,,, > ri")) . (5.4) 

Because Y is not moving, we have = r^, where y = Yq. Since x, y are not in the same clique 

ir) (^—1) (i) 

of Up, li Ty < Tv 1 then there exists 1 < i < r such that r/ ' < Ty < Tv '. By the strong Markov 

property and union bound we obtain 

rx,y(^M^’^ < T^) < rP^(ry < 
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since, when Xq = v, in order to hit y G Up before returning to v, the first time X moves it must 
jump into the clique that contains y. 

Using the above bound and Lemma [5?T] in ( |5.4[ ) we deduce 

< M^’^) < ^ + (1 - ay-\ 

Taking r = ^/n or any other function of n that goes to infinity slower than n gives that 

> 0 as n —> oo. 


We conclude from (5.3) that 


< M 


bad 


< 6 


and this finishes the proof. 


□ 


6 Sharpness of Conjecture 1.5 


In this section we describe the example pointed out by Alexander Holroyd, mentioned in the 
Introduction, of a family of transitive graphs for which < 1/3 + <5. In what 

follows we take Ax = Ay = 1 and Xz = 0. 

To construct the example, fix e G (0,1) and consider the chain with state space {0,1}*^ in which 
the j’th coordinate changes value (from 0 to 1 or vice-versa) at rate qj = — £)/(l — e”); 

note that qi = 1. The idea is that for small e, earlier coordinates change state much more 

quickly than later coordinates, so the primary obstacle to both meeting and hitting is simply the 
largest coordinate in which the value differs. For u,v £ {0, !}"■, let k{u,v) = max{i : Ui y Vi}, or 
k{u, v) = 0 u = V. 

We claim that for x,y,z G {0,1}*^, if k{x,y) > m.m{k{x, z), k{y, z)) then Px,y ,2 < 

2en. Assuming this, and taking e = 6/{2n), it follows by symmetry that, starting from stationarity, 

< h + P(fe(Ao, To) < min(fe(Ao, To), fe(To, Tq)) < <5 + ^. 

It thus remains to prove the preceding claim. 

Fix x,y,z G {0,1}"' with k{x,y) > mm{k{x, z), k{y, z)), and assume by symmetry that k{x,z) < 
k{x, y). For 1 < A: < n, let ta, = minjt : x[''^ = Zi,l < i < k} he the hrst time that Xt and z agree 
in the hrst k coordinates. It is convenient to set ro = 0. Also, let = min{t : > /c, y ^o*^} 

be the hrst time one of the last n — k + 1 coordinates of X changes, and dehne accordingly. 

We will show that for all 1 < /c < n. 


IP(rfc < cr^i) > (1 - e)^ > 1 - ke. 


( 6 . 1 ) 


Note that r^, and are all independent. Furthermore, and are identically 

distributed, so if the preceding inequality holds as written then it also holds with in place 
of We hnish proving the claim assuming that (6.1) holds, then conclude by proving (6.1). 

At time Tk[x,z): hrst k{x, z) coordinates of X agree with those of z. If Tk{^x,z) < ^k{x 2 )+i the 

remaining coordinates of X and z also agree (because they did at time 0 and they have not changed), 
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so Similarly, if and then It 

then follows, using (6.1) and the subsequent observation, that 

< P(fTg^^^)+i < Tk^x,z)) + ^{(^l{x,z)+i < '^k{x,z)) < 2k{x,z)e < 2ne , 


as claimed. It thus remains to prove (6.1). In what follows we write ak = cr^. 

Fix 1 < k < n, and note that is exponential with rate — e”). 

Furthermore, ak < ak+i precisely if the fc’th coordinate of X changes before any larger coordinate. 
It follows that F{ak < ak+i) = qk/YTj=k^j- 

(k) 

Suppose that Xq = Zk- In this case to have < ak+i it suffices that Tk-i < ak, so 


'(jk < ak+i ^ 0 ^^ = Zk'^ > F{Tk-i < ak) ■ 


(k) 

If Xq 7 ^ Zk then the k'th. coordinate must change before time r^, so to have < ak+i it is 
necessary that ak < ak+i- By the strong Markov property, we then have 


Tk < CTfc+l 


x^^^ / Zk^ = < cjfc+i)p(^rfc < CTfc+i 

(^T~k ^ ^k+1 


X^J"^ = Zk 


E n 

j=k 


— ^k 


> 1 < ^k) 


We thus have the unconditional bound 

^{Tk < 0 -fc+l) > ^ ^ 


2 _£-ri.+l—fc 


3T:P(rfc_i < ak) > (1 - e)F{Tk-i < ak ), 


This bound holds for all 1 < /c < n; since tq = 0 we also have P(to < ai) = 1, and (6.1) follows. 
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